Probabilistic reasoning is not a static calculation; it is a dynamic process of updating beliefs. In an unconditional setting, we assume a state of general ignorance where all outcomes in the sample space $S$ are possible. However, information is a mathematical filter that discards outcomes inconsistent with observed reality.
When we say event $F$ has occurred, we move from the global space $S$ to a restricted universe $F$. The conditional probability of $E$ given $F$, denoted as $P(E|F)$, is simply the proportion of the new space $F$ where $E$ also happens.
The Narrative of Evidence
The transition from $P(E)$ to $P(E|F)$ is the mathematical foundation of evidence-based estimation. If $P(E|F) > P(E)$, the evidence $F$ is supportive of hypothesis $E$. If $P(E|F) < P(E)$, $F$ contradicts $E$.
Imagine a catered event with the following fixed menu options:
| Course | Options |
|---|---|
| Entree | Chicken, Roast Beef (2) |
| Starch | Pasta, Rice, Potatoes (3) |
| Dessert | Ice cream, Jello, Apple pie, Peach (4) |
Unconditional Space: There are $2 \times 3 \times 4 = 24$ total possible meal combinations. $P(\text{Pasta}) = 8/24 = 1/3$.
Conditional Information: We learn the guest is a vegetarian who definitely chose the "Pasta." Our "Starch" choice is now fixed ($1$ option). The denominator of our universe collapses from $24$ to $2 \times 1 \times 4 = 8$. This is the power of information: it shrinks the sample space and shifts the denominator.
Defining the Formula
For any two events $E$ and $F$, if $P(F) > 0$, the conditional probability is defined as:
$$P(E|F) = \frac{P(EF)}{P(F)}$$